The speed of the internet has little to with ping, sometimes slower connection hold better than fast one, but the matter is usually packet loss,packet shaping and slowing down ports by the ISP.
Never use wireless, that means packetloss for sure.
I had this problem for a while, and complained to my isp, who didnt do anything about it cos i was a "online player", but i kept on and all of a sudden they fixed it.
The explaination was that LFS uses high ports, around 30000, and there they slow down ports to slow down P2P downloads.